Automatic Parallelization for Distributed - MemorySystems : Experiences
نویسندگان
چکیده
Distributed-memory systems (DMMPs) are powerful tools for solving large-scale sci-entiic and engineering problems. However, these machines are diicult to program since the data must be distributed across the processors and message-passing operations must be inserted for communicating non-local data. In this paper, we discuss the automatic parallelization of Fortran programs for DMMPs, based on the programming paradigms associated with Vienna Fortran and High Performance Fortran. After introducing the state of the art, as represented by currently implemented systems, we will identify a number of limitations of this technology. In addition to insuucient functionality for handling many real applications, a major deeciency of current systems is the lack of intelligence in selecting good transformation strategies. We argue that a knowledge-based approach to compiling will contribute to more powerful and intelligent automatic parallelization systems in the future.
منابع مشابه
Comparative Survey of Approaches to Automatic Parallelization
Automatic parallelization in a compiler is becoming more important as computer technologies expand to include more distributed computing. This paper focuses on a comparative study of past and present techniques for automatic parallelization. It includes techniques such as scalar analysis, array analysis, and commutativity analysis. The need for automatic parallelization in compilers is growing ...
متن کاملComparison Of Automatic And Manual Techniques For Distributed Computing
Manual Parallelization, Understand the Problem and the Program Distributed memory systems require a communication network to connect May be able to be used in conjunction with some degree of automatic parallelization. To enhance the technique, the structure of a complex network can be extended. A comparison analysis of environmental factors affecting software reliability Automatic detection of ...
متن کاملParallelization of Radiation Therapy Treatment Planning(RTTP) : A Case Study
Radiation therapy uses ionizing radiation to treat cancerous tumors. This paper reports our experiences with the parallelization of a real-world 3-D radiation therapy treatment planning (RTTP) system on a wide range of platforms, including SMP servers, Cray J916 vector machines, and clusters of SMPs. The RTTP system is a meta-problem, comprising two major loosely-coupled components: dose calcul...
متن کاملDistributed Machine Learning: Foundations, Trends, and Practices
In recent years, artificial intelligence has achieved great success in many important applications. Both novel machine learning algorithms (e.g., deep neural networks), and their distributed implementations play very critical roles in the success. In this tutorial, we will first review popular machine learning algorithms and the optimization techniques they use. Second, we will introduce widely...
متن کاملComputer Science Technical Report Canonic Multi-Projection: Memory Allocation for Distributed Memory Parallelization
The Polyhedral model is now the accepted technology for automatic parallelization of affine control loop programs. It has been successful in automatically generating tiled shared memory parallel programs for shared memory platforms (plus vectorization). We address the challenges arising when we move toward distributed memory parallelization, based on wavefront execution of parameterized tiles. ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1993